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1.  INTRODUCTION 


This  is  Part  II  in  a  sequence  of  papers,  the  first  one  being  [1].  We 
have  tried  to  make  the  presentation  essentially  self-contained  by  restating 
certain  results  without  proofs,  but  we  shall  frequently  refer  the  reader  to 
Part  I  for  details.  Part  I  also  contains  a  more  detailed  introduction  to  the 
problem  under  study  and  an  historical  account  of  it,  as  well  as  a  relevant  list 
of  references. 

Given  an  m-dimensional  stationary  stochastic  process  {y(t);  t  e  R},  which 
is  real,  Gaussian,  purely  nondeterminist ic ,  mean  square  continuous  and  centered, 
the  basic  problem  is  to  find  representations  of  the  type 

y (t)  =  Cx  (t)  C1-1) 

where  C  is  a  linear  time-invariant  operator  and  (x(t);  t  e  R}  is  a  (generally 
infinite  dimensional")  vector  Markov  process,  for  which  we  can  obtain  a  differ¬ 
ential  equation  representation. 

This  problem  can  be  given  a  mathematically  more  precise  formulation  in 
a  Hilbert  space  setting.  To  this  end,  define  H  to  be  the  Gaussian  space 
generated  by  y,  i.e.,  the  linear  hull  of  the  random  variables  (y^Ct);  t  e  R, 
k  =  1,2  ...,  m}  closed  in  L2  norm.  The  space  H  is  a  Hilbert  space  with  inner 
product  <£,n>=  E{£n},  where  E{»}  denotes  mathematical  expectation.  To  de¬ 
scribe  the  dynamical  aspects  of  the  problem  we  need  to  define  the  past  and 
the  future  of  H  and  to  introduce  a  shift  operator  on  H:  Let  the  past  space  H" 
and  the  future  space  H+  be  the  closed  linear  hulls  in  H  of  t  s  0, 

k  =  1,2,  ...,  m}  and  (y^ft);  t  2  0,  k  =  1,2,  ...,m}  respectively.  Moreover, 
since  y  is  stationary,  there  is  a  strongly  continuous  group  {Ut;  t  e  R)  of 
unitary  operators  H  -*■  H  such  that  y,  (t)  =  Ut_sv  (s)  for  all  t,s  and  k [ 2 ]  . 

Given  three  arbitrary  subspaces  A,B  and  X  of  H,  we  shall  write  A  1  B  when 
A  and  B  are  orthogonal  and  A  1  BlX  when  they  are  conditionally  orthogonal 


XX  v 

given  X,  i.e.,  <L  ot.  E  8>  =  <a,8>  for  all  a  t  A  and  8  «  B,  where  l 

denotes  orthogonal  projection  onto  X.  Finally  we  shall  write  A  v  B  to  de¬ 
note  the  closed  linear  hull  of  A  and  B. 

The  problem  at  hand  can  now  be  formulated  as  a  geometric  problem  in  the 
Hilbert  space  H:  Find  all  subspaces  X  such  that 

(i)  X  is  Nai'kovian,  i.e. 

X'  i  X*|X  (1.2) 

where  X~  :«Vt  s  Q  (UtX)  and  X*  :=  Vt  2  0  (l^X) . 

(ii)  yk (° )  i  x  for  k  =  1,  2,  ....  m 

(iii)  X  is  minimal,  i.e.,  there  is  no  proper  subspace  of  X  satisfying 
(i)  and  (ii). 

F.ach  solution  X  of  this  problem  gives  rise  to  a  representation  of 
type  (1.1).  In  fact,  a  vector  process  (x(t);  t  t  R)  taking  values  in  some 
suitable  function  space  can  be  constructed  by  appropriately  choosing  a  basis 
in  X  and  applying  the  shift  to  its  components.  (Note  that,  since  y  is 

mean-square  continuous,  H  is  separable.)  In  view  of  ( i ) ,  this  process  must 
be  Markov.  Condition  (ii)  then  yields  a  representation  (1.1).  Finally, 

(iii)  insures  that  the  state  space  X  is  as  small  as  possible.  In  Section  7 
we  shall  describe  how  this  choice  of  basis  is  made  in  the  finite  dimensional 
case  (dim  X  <  °°) ,  postponing  the  infinite  dimensional  case  to  a  subsequent 
paper,  Part  III.  (The  geometric  theory  of  Sections  2-6  does  not,  however, 
require  any  restriction  of  the  dimension  of  X.) 

This  paper  constitutes  not  merely  a  sequel  of  Part  I;  it  contains  many 
extensions,  generalizations  and  other  improvements  of  the  results  presented 
in  Part  I.  We  have  found  that  the  geometric  theory  is  most  easily  understood 
and  explained  in  terms  of  perpendicularly  intersecting  subspaces,  and  we  de¬ 
vote  Sections  2  and  3  to  this  reformulation.  In  Section  4,  we  show  how  the 


I 


concepts  of  deterministic  realization  theorv  [3.4]  can  be  used  to  provide  fur¬ 
ther  insight  into  the  stochastic  theory,  and  Section  S  and  t>  contain  extensions 
of  the  spectral  domain  theory  presented  in  [1|.  Sect  ion  7,  finally,  is  devoted 
to  dynamical  representations  of  finite  dimensional  state  spaces. 


2.  PERPENDICULARLY  INTERSECTING  SUBSPACES 

Let  A  and  B  be  two  (closed)  subspaces  of  the  Hilbert  space  H.  We 
shall  say  that  the  subspace  \  c  H  is  an  (A,F)~nr'  i  tt  :tu;  4*uK»:\j.v  if 


A  i  BIX 


1 2 .  n 


If  there  is  no  proper  subspace  of  X  which  also  satisfies  (2.1).  X  is  said 
to  be  mir.iryil .  The  purpose  of  this  sect  ion  is  to  determine  under  what  condi 
tions  on  A  and  B  there  is  only  minimal  ( A , B) - spl i t t inc  subspace. 

LEMMA  2.)  The  re  :‘:i  o'te  only  one  rrininol  (A,F)-rvlitti>u;  o.oe  eon- 

tanned  in  A  (in  B1  ,  ruj mely  X  *  I  B  (X  »  E^A)  .  (The  bar  over  the  1'  denotes  closure 

Proof.  The  useful  decompos it  ion  formula 

A  =>  EAB  #  (A  n  B1)  ^  '  ."I 

-  A  L  -  ,\ 

implies  that  F.  B  =  A  e  (A  n  B  )  and  that  A  o  F  B  i  B,  the  latter  of  which  is 

-A 

equivalent  to  (2.11  with  X  >  E  B.  On  the  other  hand,  any  (A. BY-snl itt inc 
subspace  X  containing  A  satisfies  A  o  X  i  B.  i.e.,  A  o  X  c  A  n  B1,  or 
equivalently  X  3  A  e  (A  n  B1),  i.e.,  X  j  ?  A.  □ 

LEMMA  2.2  All  (A.BWr  *»  t  i  z  •»  \?  '*»  f » « r*  *•  *\  n  B 

Proof.  Let  n  e  An  B.  Then  n  i  q|X,  i .e. ,  p  *  X.  D 

Consequently,  if  there  is  onlv  one  (A.B)-snl itt ins  subspace,  we  have 
£AB  ■  E**A  *  A  n  B.  Conversely,  if 


ITB  »  An  B. 


(2..M 


and  it  must  be  the  only  minimal  (A , B) -spl itt in»s  subspace,  since  all  such  sub 


spaces  contain  A  n  B  (Lemma  2.21.  We  shall  say  that  A  and  B  intersect 
perpendicularly  if  one  of  the  two  equivalent  conditions  (2.31  or  (2.41  holds. 

PROPOSITION  2.1.  There  is  a  unique  'ninimal  (A.B)-ap’  :* iting  suberic, 
if  an<i  only  if  A  ,md  B  intersect  perpendicularly  end  it  ie  aicen  by  ( .  c' ) 
and  (2.4'. 

The  following  proposition  provides  an  alternative  character i rat  ion  of 
perpendicular  intersection  of  subspaces  in  the  case  that  they  span  the  whole 
space . 


PROPOSITION  2.2.  Let  A  v  b  *  H.  Then  A  and  B  intersect  perpendi¬ 
cularly  if  ,znd  cnly  if  B1  c  A,  or  equivalently ,  A1  c  B.  (Here  A1  denotes 
the  orthogonal  complement  of  A  in  H.l 

Proof.  ( i  f  1  :  Assume  that  R1  c  A  holds.  Set  X  =  L"‘V  Then  (2.21 
yields  A  »  X  ®  S'1",  from  which  it  follows  that  X  c  B  and  that  A  n  B  =  X. 

(only  if):  Set  X  =  O'^R  and  assume  that  X  =  A  n  B.  Then  it  follows 
from  (2.2)  that  (A  e  X)  j.  R.  Therefore,  since  A  v  B  =  It  and  R  d  X, 


B  c  A. 


the  sequel,  we  shall  need  the  following  simple  observation,  the  proof 


of  which  is  trivial 


LEMMA  2.3.  Let  A,  B,  A'  and  B'  be  four  subspaces  suck  that  A  c  \< 
.rui  R  c  B' .  Then  any  (A',B ')-spl ittina  sul'space  is  alec  ,r:  (A.Rl -splitti' 
subs'cace. 


3.  THE  GEOMETRY  OF  SPLITTING  SUBSPACES  REVISITED 

Our  basic  problem  is  to  determine  the  set  of  all  minimal  (H",li+1- 
splitting  subspaces,  where  H  and  M*  are  the  past  and  future  spaces  of  the 


0 

given  stochastic  process  { >'  1 1 )  :  t  c  R  > ;  we  shall  usually  drop  the  prefix 
(H  ,H+)  ,  plain  "splitting  subspace"  referring  to  the  pair  (H  ,ll+) .  If  H  and 

H  intersect  perpendicularly  there  is  only  one  minimal  splitting  subspace, 
namely  the  present  space 

11°  *  H‘  n  H+  (3.1) 

(Proposition  2.1).  When  y  has  a  rational  spectral  density,  this  corresponds 
to  the  case  where  y  can  be  realized  by  a  purely  autoregressive  scheme.  How¬ 
ever,  in  general  this  is  not  the  case,  and  there  is  a  whole  family  of  minimal 

splitting  subspaces,  two  of  which  are  the  forward  and  backward  predictor 
_H-  ^  -  H+ 

spaces  X  :=  E  H  and  X+  :  =  E  H  respectively  (Lemma  2.1).  Defining 
N  :=  H  ©  X  and  N*  :=  H*  ©  X+  we  obtain  the  orthogonal  decomposition 

H  =  N~  ©  H°  ©  N+ ,  (3.2) 

where  H  is  the  Gaussian  space  of  the  process  v  and  Ha  is  the  frame  space 
H°  : =  X  v  X^.  In  Part  I,  we  showed  that  all  minimal  splitting  subspaces  X 
satisfy 

11°  c  X  c  H°,  (3.3) 

i.e.,  the  frame  space  is  the  closed  linear  hull  of  all  minimal  splitting  sub¬ 
spaces,  hence  containing  all  pertinent  information  about  v.  We  shall  call 
N  and  N*  the  junk  spaces  since  all  information  in  them  may  be  discarded. 

By  applying  (2.2),  it  is  immediately  seen  that  N  =  H  n  (H*)1  and  N+  = 

H+  n  (H  )A.  In  the  special  case  that  H  and  H+  intersect  perpendicularly 
H3  and  H°  coincide. 

The  following  theorem  expresses  the  fact  that  any  (minimal  or  nonminimall 
splitting  subspace  can  be  regarded  as  a  minimal  splitting  subspace  if  the  past 
and  future  spaces  are  extended  so  that  they  intersect  perpendicularly. 


A 


THEOREM  3.1.  The  space  X  c  II  is  a  splitting  subspare  if  and  snip  if  it 
is  the  (unique)  - rininal  (S,§)~splitting  subspare 

X  =  S  n  §  (3.4) 

far  some  perpendirularly  intersecting  subspares  S  and  S  surh  that  S  ■>  H" 
arui  5  ^  H*.  The  rorrespondenre  X  <-*  ( S ,  § )  :  a  one-one,  the  pair  (S,5)  being 


uni  one lu  determined  bn  the  relations  S  =  H  v  X 


S  »  H  v  x. 


COROLLARY  3.1.  Representation  (3.4)  may  also  be  written  in  anu  of  the 
'•oin a  -'our  eguivalent  mus: 


S  e  S1 

(3.5) 

i  ,1 

6  0S 

(3.6) 

-Sr; 

E  § 

(3.7) 

E'SS. 

( 3 .  S ) 

in  Part  I  states  that  1 

(  is  a 

splitting  subspace  if 

and  only  it'  (3.5)  or  (3.6)  holds  t'or  some  S  ^  H  and  S  o  H  ,  and  that  X 
and  (S,$)  are  related  as  in  the  last  sentence  of  the  present  theorem.  Put 
then  S1  c  S,  and  therefore  S  and  S  intersect  perpendicularly  (Proposition  2.2) 
and  X  is  given  by  (3.4)  (Proposition  2.1).  Relations  (5.7)  and  (3.S)  follow 
by  comparing  (3.5)  and  (3.6)  to  (2.2).  0 

A  subspace  containing  the  past  space  II  will  be  called  an  extended 
past  spare  and  one  containing  the  future  H+  an  extended  future  spare.  We 
shall  say  that  an  extended  past  space  S  (extended  future  space  5)  is  rininal 
if  there  is  a  minimal  splitting  subspace  X  such  that  S  =  H  v  X  (§  =  H+  v  X). 
This  definition  coincides  with  that  in  [5]  for  regular  Markovian  splitting  sub¬ 
spaces  (to  be  defined  shortly). 


_Ld_a_ 


■M 


PROPOSITION  3.1.  An  extended  past  space  S  is  minimal  if  and  only  if 

(3.9) 


♦  I 

Sc  (N  3 


rut  an  extended  Auture  sraee  S  is  minimal  i rui  cnlu  if 


S  c  iN')1. 


(3.10) 


Proof.  lif):  In  the  first  case,  choose  S  =  S1  v  ||+  and  in  the  second 
case,  S  =  S1  v  H  .  Then  it  follows  from  Theorem  3.1  in  Part  I  that  X  :  = 

S  o  S  is  the  required  X. 

(only  if):  Since  a  minimal  splitting  subspace  X  is  contained  in  H°, 
we  have  S  =  H  v  X  c  (N*)1  and  S  =  H+  v  x  c  (N  l1.  □ 

The  reason  for  this  definition  of  minimality  will  become  clear  in  Sec¬ 
tion  5.  Note  that  an  arbitrary  pair  (S,S)  of  perpendicularly  intersecting 
minimal  extended  past  and  future  spaces  will  not  necessarily  define  a  minimal 
splitting  subspace  X,  although  any  such  X  will  be  contained  in  the  frame 
space  Ha.  For  X  to  be  minimal ,  the  pairing  of  S  and  S  must  be  done  in 
a  more  precise  manner.  This  leads  to  the  concepts  of  observability  and  con¬ 
struct  ibil ity  as  defined  by  Ruckebusch. 

-X  + 

A  splitting  subspace  is  said  to  be  observable  if  E' H  =  X  and  ron- 
-X  - 

strurtible  if  E  II  =  X.  In  Part  I,  we  showed  that  X  =  S  n  S  is  observable 
if  and  onlv  if 


S  =  S1  v 


and  construct ible  if  and  onlv  if 


si 


(3.11) 


S  =>  5~  v  H  ,  (3.12) 

PROPOSITION  3.2.  Let  X  be  a  split  tins  sub  j  fZYlel  S  CtXliX  ^ 
be  the  corresrondi’u;  extended  vast  ana'  ft  tune  snares.  Then  the  followina 


1 


A 


renditions  are  equivalent: 


3 


(i) 

X 

1 3 

minimal 

(ii) 

X 

is 

observable  and  cons 

tructible 

(ii  i) 

X 

ts 

observable  and  S  is 

minimal 

(iv) 

X 

is 

constructible  and  S 

is  minimal 

For  a  proof  of  the  equivalence  of  (i)  and  (ii),  see  [6]  or  Proposition  4.2 
below.  Keeping  Proposition  3.1  in  mind,  the  rest  follows  from  Theorem  3.1  of 
Part  I.  Note  that  minimality  of  X  imposes  a  definite  pairing  of  S  and  S. 
For  example,  X  corresponds  to  S  :=  H  and  S  ;=  (N  )i  and  X+  to  S+  •'  = 
(nV  and  S+  :  =  H+. 

.Among  all  minimal  splitting  subspaces  X  we  shall  eventually  only  be  able 
to  use  those  which  are  Markovian,  i.e.,  those  which  satisfy  condition  (1.2). 

As  pointed  out  in  Part  I  (the  original  reference  is  [6]),  X  is  Markovian  if 
and  only  if  the  corresponding  extended  spaces  S  and  S  satisfy  the  follow¬ 
ing  two  conditions: 

U^S  c  S  for  all  t  <  0  (3.13) 

Ut§  c  §  for  all  t  >  0.  (3.14) 

i.e.,  S  must  be  left  invariant  and  S  right  invariant  (under  the  shift  U^)  . 

Note  that,  if  X  is  observable,  we  need  only  impose  condition  (3.13);  then, 

in  view  of  (3.11),  (3.14)  will  follow  automatically.  In  the  same  way,  only 
(3.14)  is  needed  when  X  is  constructible .  It  is  easy  to  see  that  for  a 
Markovian  splitting  subspace  S  =  X  and  S  =  X+,  i.e.,  X  and  X+  inter¬ 
sect  perpendicularly.  In  general,  S  and  S  are  given  by  S  =  ©  S,  and 

§=§.«§,  where  S.,  and  S-,  are  doubly  invariant,  i.e.,  they  satisfy  both 
(3.13)  and  (3.14),  whereas  and  are  only  simply  invariant.  Then 

n  n  US  =  S,  and  n.  .  U  S  =  i.e.,  S„  and  S,  are  the  purelv  deter- 

t  £  K  t  Z  x  €  K  t  Z  Z  Z 

ministic  parts  of  S  and  S  respectively.  If  S.,  =  0  (S^=0)  ,  we  shall  say 
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that  S  (SI  is  purely  nondeteministio .  A  splitting  subspace  for  which  both 
extended  spaces  S  and  S  are  purely  nondeterminist ic  will  be  called  regular. 
In  view  of  Lemma  2.1  of  Part  I  and  the  fact  that  S  c  S,  both  S  and  S  are 
full  range  whenever  X  is  regular.  The  usefulness  of  this  concept  is  that  the 
class  of  regular  Markovian  splitting  subspaces  is  in  one-one  correspondence  with 
a  certain  class  of  pairs  (W,W)  of  full-rank  factors  of  y,  W  being  stable 
and  W  strictly  unstable.  We  shall  return  to  this  in  Section  5. 

To  insure  that  all  minimal  splitting  subspaces  are  regular,  we  need  to 
introduce  the  concept  of  noncyclicity.  We  say  that  the  given  process  v  is 
nemeyolio  if  it  has  nontrivial  junk  spaces,  i.e.,  N  *  0  and  N  *  0,  and 
strictly  noncyclie  if  both  N  and  N  are  full  range. 


PROPOSITION  3.3 


strzctiu 


Then  all  irininal 


suosvaces  are  reauuir. 


Proof.  If  N  and  N+  are  full  range,  (N  and  (N  j1  are  purely 
nondeterminist ic  (Part  I;  Lemma  2.1j.  Hence,  the  proposition  follows  from 
(3.91  and  (3.10).  □ 


4.  HANKEL  OPERATORS  AND  MINIMALITY  OF  SPLITTING  SUBSPACES 

Given  an  arbitrary  splitting  subspace  X,  there  is  a  unique  pair  (S,S) 

of  perpendicularly  intersecting  subspaces  such  that  S  o  H  ,  S  =>  H  and 

X  =  S  n  S  (Theorem  3.1).  We  shall  try  to  gain  some  further  insight  into  the 

conditions  under  which  the  state  space  X  is  minimal  by  applying  the  basic 

concepts  of  deterministic  realization  theory  [3,4].  Let  G:  S  -*•  S  and  G*  : 

-  S  A 

S  -*  S  be  the  Henkel  operators  G  =  E  |g  and  G*  =  E‘lg,  where  A|^  denotes 
the  restriction  of  the  operator  A  to  the  domain  B.  Furthermore,  let  R(A) 
denote  the  closure  of  the  range  and  N(A)  the  null  space  of  A. 


^  jj'ig  v 
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PROPOSITION  4.1.  The  operators  G  and  G*  are  adjoints.  Moreover, 

N(G)  =  S1,  N(G*)  =  S1  and 

R(G)  =  R(G*)  =  X.  (4.1) 

where  X  =  S  n  S. 

Proof.  To  see  that  the  first  statement  is  true,  note  that  for  all  s  e  S 
and  s  <■  S 

<Gs,s>s  =  <s,s>  =  <s,G*s>g, 

where  <•,*>  *s  the  inner  product  restricted  to  S.  Relations  (4.1)  follow 
from  (3.7)  and  (3.8),  and,  since  S1  c  S  (Proposition  2.2),  W(G)  =  S1.  In 
the  same  way,  it  is  seen  that  W(G*)  *  S1.  □ 

By  Corollary  3.1,  X  =  SeS1=S©  S1.  Consequently,  X  is  isomorphic 
to  the  quotient  spaces  S/S1  and  S/S1,  i.e., 

X  -  S/N(G)  and  X  «  S/W(G*)  (4.2) 

(Proposition  4.1).  Actually,  by  choosing  representations  in  the  equivalence 
classes  properly,  we  may  identify  X  directly  with  the  quotient  spaces  in  (4.2). 

The  formulas  (4.1)  show  that  the  factorizations  of  G  and  G*  through 
X  described  by  the  commutative  diagrams 

G  G* 


S  - ►  S  S  - ►  S 


(where  J :  X  ■+■  S  and  J:  X  -*■  S  are  the  insertion  maps  Jx  =  Jx  =  x)  are 

X  X 

canonical  in  the  sense  that  E'  |g  (E  I,.)  maps  onto  a  dense  subset  of  X  and 
J  (J)  is  one-one.  This  canonical  property,  as  well  as  (4.2),  illustrates 
the  fact  that  X  is  a  minimal  (S,S) -splitting  subspace.  (Cf[3;  p.259].) 


i  •  i 


We  shall  now  relate  this  approach  to  the  concepts  of  observability  ami  con 
struct ibi 1 ity  defined  in  Section  a  by  investigating  under  what  conditions  X  i 


a  rninbryxl  splitting  subspace  [with  respect  to  1 1 1  .11  1  [  .  The  following  lemma 
provides  us  with  two  splitting  subspaces  which  are  potentially  smaller. 


G 


LEMMA  4.1.  Consider 

:■  G*|h-.  Then  R(G*1 


the  restricted  Hooike!  opemtors  G 
itrui  R(G~1  urv  splitting  subspo.oes 


til  ♦ 
'll 


\. 


Proof.  It  suffices  to  prove  the  statement  concerning  G+;  then  the  one 

-  4-  ♦ 

about  G  follows  by  symmetry.  Trivially  R(G  1  -  JC i G 1  .  and  hence  R(G  1  .  \ 

♦  .  S  ♦  ♦ 

(Proposition  4.11.  Obviously,  the  predictor  space  R(G  1  *  r  II  is  an  (S.ll  1 
splitting  subspace,  and  hence  also  a  splitting  subspace  (Lemma  2.31.  [1 

4- 

It  is  therefore  natural  to  consider  the  factorizations  ol  G  and  G 
through  X  induced  by  those  in  (4.31,  i.e.. 


♦ 

G  G 


II*  - *  S  ll"  - *S 


where  0  | is  the  obseri'abi  Htp  operator  and  C  :=  F,  1^-  the 

const  met ibi l ftp  operator.  The  first  factorization  is  canonical  if  and  only 
if  0  maps  onto  a  dense  subset  of  X.  i.e.,  X  is  observable,  in  which  case 
X  =  R(G*1 .  The  same  statement  holds  for  the  second  factorization  (  1 .41  if  we 
exchange  0  for  C,  G+  for  G  and  observable  for  constructible.  Conse¬ 
quently,  minimality  of  X  is  equivalent  to  both  factorizations  being  canonical 
(Proposition  3.21.  Note  that,  unlike  the  situation  in  deterministic  realiza¬ 
tion  theory  [3,4],  t:.v  factorizations  are  needed.  In  this  respect,  construct i- 
b i 1 ity  is  a  form  of  dual  observability  and  does  not  correspond  to  reachability. 
The  "reachability  operators"  d  and  its  dual  .1  are  alwavs  one-one  and  play 


no  important  role  here.  (Since  in  effect  we  are  working  with  spaces  of  func¬ 
tionals  of  inputs  and  outputs,  both  diagrams  are  dualized  as  compared  to  the 
deterministic  setting  in  the  sense  that  all  arrows  and  the  order  between  the 
observability  and  reachability  operators  have  been  reversed.) 

The  previous  discussion  suggests  that  a  splitting  subspace  X  is  observ¬ 
able  if  and  only  if,  for  a  given  S,  S  is  as  small  as  possible,  and  that, 
dually,  the  same  holds  for  constructibility  exchanging  S  for  S  and  vice 
versa.  To  clarify  this  point,  first  consider  the  following  lemma. 

LEMMA  4.2.  Let  X  and  X'  be  two  splitting  subspaees  and  let  (S,S) 
and  (S',S')  be  the  corresponding  extended  past  and  future  spaces.  Then  X  <=  X’ 
if  and  only  if  S  c  s'  and  S  c  S'. 

Proof.  In  view  of  (3.4),  the  (if) -part  is  trivial.  It  remains  to  prove 
(only  if).  Since  S  =  H  v  x  (Theorem  3.1),  X'  c  x  implies  that  S'  c  s. 

The  rest  follows  by  symmetry.  □ 

Consequently,  in  order  to  obtain  a  minimal  X  =  S  n  S,  we  must  reduce 
S  and  S  as  much  as  possible.  Now,  keeping  S  fixed,  it  is  easy  to  see 
that  the  smallest  S  which  both  contains  H+  and  intersects  S  perpendicularly 
is  S  =  H+  v  s1,  i.e.,  exactly  the  condition  (3.11)  for  observability.  Like¬ 
wise,  keeping  S  fixed,  S  =  H  v  S1  is  the  smallest  subspace  containing  H 
and  intersecting  S  perpendicularly,  yielding  the  constructibility  condition 
(3.12).  We  shall  now  discuss  some  consequences  of  these  observations. 

First,  this  provides  us  with  an  alternative  proof  of  the  equivalence  of 
conditions  (i)  and  (ii)  in  Proposition  3.2,  which  we  restate  here  in  a  some¬ 
what  stronger  form. 


i 


■ 


I 

i 

i 


‘  •  -  • 


-■  ''imamm* . ^ 


X 


PROPOSITION  4.2.  Let  S  a  II  arui  S  :>  M  be  tuo  arbi tit  try  subspaoea, 
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r\i  set  X  ■  S  n  §.  Then  X  is  a  minimal  splitting  subspace  if  ami  only  if 
both  conditions  (3.111  atki  (3.1H)  hold. 

Proof.  (if):  Assume  that  (3.11)  and  (3.12)  hold.  The  S1  c  §,  i.e., 

S  and  S  intersect  perpendicularly  (Proposition  2.2).  Hence,  X  is  a  split¬ 
ting  subspace  (Theorem  3.1).  It  remains  to  show  that  X  is  minimal.  In  order 
to  reduce  X  either  S  or  S  or  both  must  be  reduced  while  neither  can  be 
enlarged  (Lemma  4.2).  But  this  is  inconsistent  with  (3.11)  and  (3.12),  since 
S  and  §  will  not  be  reduced.  Hence  X  is  minimal. 

(only  if):  Suppose  that  X  is  a  minimal  splitting  subspace.  Then  the 
pair  (S,5)  is  uniquely  determined;  we  must  have  S  =  H  v  x  and  S  =  H+  v  X 
as  in  Theorem  3.1.  In  fact,  under  the  given  conditions,  neither  S  nor  S 
can  be  smaller,  and  enlarging  (say)  S  (as  given  by  Theorem  3.1),  to  S  *  Z 
will  yield  (S  «  Z)  n  S  =  X  <»  Z  *  X,  since  Z  c  S1  c  3  (Proposition  2.2). 

Now  assume  that  (say)  (3.11)  does  not  hold.  Since  S  contains  H+  and  inter¬ 
sects  S  perpendicularly,  S  =>  H*  v  s1.  Then,  by  the  discussion  above,  S 
can  be  reduced  to  H+  v  S1.  Since  5  =  H+  v  X,  this  would  reduced  X  too, 
contradicting  minimality.  □ 

Secondly,  given  any  splitting  subspace,  the  above  procedure  defines  an 
algorithm  by  which  a  minimal  splitting  subspace  can  be  constructed. 

PROPOSITION  4.3.  Let  X'  be  an  arbitrary  splitting  subspace  and  define 
§  :*  H+  v  (H~  v  X')1'  and  S  :=  if  v  S1.  Set  X  =  S  n  S.  Then  X  is  a  minimal 
splitting  subspace.  If  X'  is  Markovian,  then  so  is  X. 

Proof,  (i)  To  show  that  X  is  a  minimal  splitting  subspace,  it  only 
remains  to  prove  that  S  =  H*  v  S'1  (Proposition  4.2).  The  given  condition 
S  *  H  v  S1  implies  that  S1  c  S,  and  consequently  H*  v  S'1  c  S. 
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Set  S'  *  H  v  X' .  Then,  since  (S'-)1  c  S,  S'  contains  II  and  intersects  § 
perpendicularly.  But  S  is  the  smallest  subspace  with  this  property.  Hence, 

S  c  S' ,  i.e.,  (S'  1 1  c  S1 ,  which  implies  that  S  c  H+  v  S1.  Hence,  S  =  11*  v  S1 
as  required . 

(ii)  To  prove  that  X  is  Markovian,  we  must  show  that  (3.13)  and  (3.14) 
hold.  Since  X'  is  Markovian,  S'  satisfies  (3.13).  Then  (S')1  satisfies 
(3.14)  and,  since  the  same  is  true  for  H+ ,  S  also  satisfies  (5.14).  Now, 
by  a  symmetric  argument ,  it  is  seen  that  S  :*  H  v  S1  satisfies  (3.13).  □ 


5.  SPECTRAL  REPRESENTATION  OF  REGULAR  MARKOVIAN  SPLITTING  SUBSPACES 

Since  the  given  process  v  is  stationary,  mean-square  continuous  and 
purely  nondeterminstic ,  it  has  the  spectral  representation 

y (t)  =  |  est  dv(s)  (5.1) 

where  integration  is  over  the  imaginary  axis  and  dv  is  an  orthogonal  stochas¬ 
tic  vector  measure  such  that 

E{d^(iw)dy(iu>)*}  =  <Kiafldw,  (5.2) 

♦  being  the  mxm  spectral  density.  Assume  that  <l>  has  rank  p  s  m.  Then 
a  full-rank  spectral  factor  is  any  mxp-matrix  solution  of 

W(s) W(-s) '  =  $(s)  (5.3) 


such  that  rank  W  =  p.  To  any  such  spectral  factor,  we  may  associate  a 
p-dimensional  Wiener  process 


u  ( t ) 


— — — -du(s)  ;  du  =  W  *"dy , 


(5.4) 


which  spans  the  whole  space  H  (see  Part  I).  (W  is  the  left  inverse  of  W.) 
Let  U  denote  the  class  of  all  such  Wiener  processes.  Let  H  (du)  and  H  (du) 
be  the  closed  linear  hulls  in  H  of  respectively  the  past  and  the  future  of 


i 

/ 


. 
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the  process  u.  We  shall  say  that  W  is  stable  if  its  rows  belong  to  the 


Hardy  space  H ^  of  p-dimensional  functions  f  which  are  analytic  in  the  open 

’  2 

right  half-plane  and  such  that  ||  f(o  +  iw) 1 1  dw  is  uniformly  bounded  for 
all  o  >  0,  and  strictly  unstable  if  its  rows  belong  to  the  conjugate  Hardy 
space  .  Let  U+  and  U  be  the  subclasses  of  U  corresponding  to  stable 

and  strictly  stable  spectral  factors  respectively. 


LEMMA  5.1.  There  is  a  one-one  correspondence  between  stable  full-rank 
spectral  factors  W  (determined  modulo  multiplication  with  a  constant  unitary 
matrix)  and  left  invariant  [i.e.j  satisfying  ( 3. 13)]  and  purely  nondeterministic 
subspaces  S  a  H~.  The  subspace  S  is  related  to  W  by 

S  =  H"(du)  (5.5) 

where  u  e.  U+  is  the  Wiener  process  corresponding  to  W. 


LEMMA  5.2.  There  is  a  one-one  correspondence  between  strictly  unstable 
full-rank  spectral  factors  W  and  right  invariant, [i.e. ,  satisfying  (3.14)] 
and  purely  nondeterministic  subspaces  S  =  H+.  The  subspace  S  is  related 
to  W  by 

S  =  H+(du)  (5.6) 

where  u  e  U  is  the  Wiener  process  corresponding  to  W . 

The  proofs  of  these  lemmas  can  be  found  in  Part  I,  where  somewhat  differ¬ 
ently  stated  but  equivalent  results  are  given. 

It  was  shown  in  Part  I  that,  to  each  u  e  U, 

f  ^ 

f  du  H— ♦  f  (5.7) 

p 

defines  an  isomorphism  between  H  and  the  space  L^(I)  of  all  p-dimensional 
row  vector  functions  which  are  square- integrable  on  the  imaginary  axis. 


-  . 


>1 
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By  the  Paley-Wiener  Theorem  [7,8,11],  the  isomorphic  image  of  11  (dul  under 
is  precisely  the  Hardy  space  H*. 

Now,  in  view  of  Theorem  3.1  and  Lemmas  5.1  and  5.2,  X  is  a  regular 
Markovian  splitting  subspace  if  and  only  if 

X  =  H'Cdu’l  a  H+(du)  (5.81 

for  some  u  t  11 *  and  Cl  e  U  such  that  H  (du]  and  H+(du]  intersect  perpen¬ 
dicularly. 

LEMMA  5  •  3  •  I>t’  t  u  e  LI*  and  u  e  LI  ,  .md  let  W  and  W  be  the  correspond- 
ing  spectral  factors.  Set 

K  =  W  ~LW.  (5.91 

Then  S  :=  H  (dul  and  S  : =  H+ (du)  intersect  perpendicularly  if  and  only  if 
K  is  an  inner  function.  (See  Part  I  for  definition.] 


Proof.  The  subspaces  S  and  S  intersect  perpendicularly  if  and  only 
if  S1  c  s  (Proposition  2.2],  i.e.,  H  (dul  c  H  (du] ,  the  isomorphic  image 
of  which  (under  ]  is  H*K  c  H*;  to  see  this  use  Lemma  4.3  of  Part  I. 

Since  S'1  is  full  range  and  left  invariant,  Lemma  4.1  of  Part  I  can  be  used 

-  a  +  P 

to  show  that  Q^S  =  H,K  is  a  full-range  invariant  subspace  of  L ^ ( I ]  [?]. 

Hence,  in  view  of  the  Beurling-Lax-Helson  Theorem  [7],  H* K  c  H*  if  and  only 

if  K  is  inner.  □ 

By  Corollary  3.1,  (5.81  can  be  written  X  =  H  (du]  e  H  (du] ,  the  iso¬ 
morphic  image  of  which  (under  Qu  ]  is  Q^X  =  H*  e  (H*K] .  Consequently 

X  =  (H*K]\lu ,  (5.101 

where  u  e  U  is  the  Wiener  process  corresponding  to  W,  and  the  superscript  1 
denotes  orthogonal  complement  in  H*.  We  collect  these  observations  in  the 
following  theorem,  which  is  a  slight  generalization  of  Theorem  4.1  in  Part  I. 
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THEOREM  5.1.  The  subspace  X  is  a  regular  Markovian  splitting  subspace 
if  and  only  if  (5.10)  holds  for  some  pair  (W,W)  of  full  rank  spectral  factors 
such  that  W  is  stable ,  W  is  strictly  unstable,  and  K  :=  W~LW  is  inner. 

In  particular,  if  y  is  strictly  noncyclic,  all  minimal  Markovian  split¬ 
ting  subspaces  are  given  by  Theorem  5.1  (Proposition  3.3). 

6.  SPECTRAL  DOMAIN  CRITERIA  FOR  OBSERVABILITY,  CONSTRUCTIBILITY  AND  MINIMALITY 
Theorem  5.1  provides  us  with  a  procedure  to  find  all  regular  Markovian 
splitting  subspaces:  All  possible  pairs  (W,W)  of  full-rank  spectral  factors 
with  W  stable,  W  strictly  unstable  and  K  =  W  inner,  inserted  into  (5.9) 

and  (5.10),  generate  the  whole  family  of  such  splitting  subspaces.  But  how  can 
we  decide  whether  such  a  pair  will  provide  an  observable,  or  a  construct ible  or 
a  minimal  splitting  subspace?  We  need  to  translate  the  geometric  criteria  of 
Section  3  into  spectral  domain  language. 

To  this  end,  first  note  that  W  is  a  stable  full-rank  spectral  factor  if 
and  only  if  it  can  be  written 

W  =  W  6,  (b.l) 

where  0  is  an  inner  function  (for  H *  )  and  W  is  the  unique  outer  spectral 
factor,  corresponding  to  S  =  S  :=  H".  Similarly,  W  is  a  strictly  unstable 
full-rank  spectral  factor  if  and  only  if  it  has  the  representation 

W  =  W^e,  (6.2) 

where  0  is  conjugate  inner  (inner  for  H )  and  W  is  the  unique  conjugate 

outer  spectral  factor,  which  corresponds  to  S  =  S+  :=  H+. 

PROPOSITION  6.1.  Let  X  be  a  regular  Markovian  splitting  subspace,  let 
(6.1)  and  (6.2)  be  the  corresponding  spectral  factors,  and  let  k  be  defined 

by  (5.9).  Then  X  is  observable  if  and  only  if  K  *  and  0  are  right 
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coprime  and  aonstructible  if  arid  only  if 


K  and  0  are  right  coprime. 


Proof.  Let  S  and  S  be  respectively  the  extended  past  and  future 
spaces  of  X,  and  let  u  and  Q  be  the  Wiener  processes  defined  through  the 
representations  (5.5)  and  (5.6).  Using  Lemma  4.5  in  Part  I,  it  is  seen  that 
the  isomorphic  image  of  the  constructibi 1 ity  condition  (5.12)  under  the  map 
is  wt  =  (H*K)  v  (H*0) ,  which  holds  if  and  only  if  K  and  0  are  right 
coprime.  In  the  same  way,  using  the  map  Q^,  the  observability  condition 
(5.12)  is  seen  to  be  equivalent  to  K  *  and  0  being  right  coprime.  □ 

In  order  to  apply  conditions  (iii)  and  (iv)  of  Proposition  5.2,  we  also 
need  to  characterize  minimality  of  S  and  S  in  the  spectral  domain.  We 
shall  say  that  a  stable  (strictly  unstable)  full-rank  spectral  factor  is  mini¬ 
mal  if  it  corresponds  to  a  minimal  extended  past  (future)  space.  Assume  that 
y  is  strictly  noncyclic.  Then  X  and  X+  are  regular  splitting  subspaces 
(Proposition  5.5),  and  consequently  there  are  associated  pairs  (W  ,W  )  and 
(W^.W  )  of  full-rank  spectral  factors  (Theorem  5.1).  Then  define  K  and 
K+  to  be  the  corresponding  functions  (5.9).  We  showed  in  Part  I  that  in  the 
scalar  case,  all  minimal  Markovian  splitting  subspaces  have  the  same  K,  so 
that  in  particular  K  =  K+ ,  but  it  is  still  unclear  to  us  what  happens  in 
the  general  case.  Moreover  let  0+  be  the  0  in  (6.1)  corresponding  to 
W^  and  0  the  0  in  (6.2)  corresponding  to  W. 

PROPOSITION  6.2.  Suppose  that  v  is  strictly  noncyclic.  Let  W  be  a 
stable  full-rank  spectral  factor,  and  define  j  =  w~LW  .  Then  J  is  inner 
and  the  following  conditions  are  equivalent: 

(i)  W  is  minimal 

(ii)  0  is  a  left  inner  divisor  of  0+,  i.e.,  there  is  an  inner 

function  <p  such  that  04>  =  0+. 

(iii)  J  and  K+  are  right  coprime. 
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Proof.  The  equivalence  between  (i)  and  (iil  follows  from  Proposition  4.1 
in  Part  I.  The  equivalence  of  (i)  and  (iii)  follows  from  Theorem  5.1  in 
Part  I.  □ 


The  fact  that  (i)  and  (iil  are  equivalent  was  first  proven  in  [5]  in  the 
scalar  case.  The  dual  version  of  Proposition  6.2  goes  as  follows. 

PROPOSITION  6.3.  Suppose  that  v  is  strictly  ncncyclic.  Let  W  be  a 
strictly  unstable  full-rank  spectral  factor ,  and  define  J  =  IV  ~Sv .  Then  J  is 
conjugate  inner  and  the  following  conditions  are  equivalent: 

(i)  W  is  minimal 

(ii)  0  is  a  left  inner  divisor  of  0. 

(Hi)  J  and  K~*  are  right  coprime. 

7.  STATE  EQUATIONS  FOR  FINITE  DIMENSIONAL  MARKOVIAN  SPLITTING  SUBSPACES 

If  the  matrix  function  K  is  rational  the  representation  (5.101  is  par¬ 
ticularly  simple  to  realise. 

PROPOSITION  7.1.  Let  X  be  a  regular  Markovian  splitting  subspace. 

Then  X  is  finite  dimensional  if  and  only  if  K,  defined  by  (5.9),  is  rational. 

Proof.  As  pointed  out  in  Section  4,  X  =  R(G1  ,  where  G  =  Let  u 

be  the  Wiener  process  associated  to  S  through  relation  (5.51.  Then,  under 
Q^,  S  =  H.,  and  §  =  H,,K  (Part  I:  Lemma  4.31,  and  consequent ly ,  using  the 
notations  of  Section  5  of  Part  I,  G  is  isomorphic  to  the  Hankel  operator  H^.. 
Since  therefore  X  =  R(H..l  ,  dim  X  <  «*  if  and  only  if  K  is  rational  [4;  p.  395, 

N 

Theorem  3.S].  (To  prove  the  if-part,  follow  the  lines  of  the  last  part  of  the 
proof  of  Lemma  7.1.)  □ 


In  general,  there  are  no  finite  dimensional  splitting  subspaces.  One  very 
important  exception,  however,  is  the  case  when  the  spectral  density  of  y  is 
rational . 

PROPOSITION  7.2.  Let  the  spectral  density  0  be  rational.  Then  all 
minimal  splitting  subspaces  are  finite  dimensional. 

Proof.  It  is  a  well-known  fact  from  Wiener  filtering  theory  [8]  that, 

under  the  stated  condition,  the  closed  linear  hull  in  H  of  the  predictors 

H~  -H~  ♦ 

{E  y(t);  t  2  0}  is  finite-dimensional.  But  this  is  precisely  X  :=  E  H  , 

-H+ 

and  hence  dim  X  <  °».  Then,  by  symmetry,  X+  :=  E  H  is  also  finite  dimen¬ 
sional,  and  consequently  so  is  the  frame  space  H° .  Since  all  minimal  splitting 
subspaces  are  contained  in  H°  [see  (3.3)],  the  desired  result  follows.  □ 

COROLLARY  7.1.  Let  the  spectral  density  <*>  be  rational.  Then  all 
splitting  subspaces  contained  in  the  frame  space  are  finite  dimensional. 

Now  consider  a  finite  dimensional  regular  Markovian  splitting  subspace 
with  corresponding  spectral  factors  (W,W) .  Then,  by  Proposition  7.1,  K  = 

W  H)  is  rational.  Following  Forney  [9],  we  consider  the  vector  space  V^. 
of  2p-tuples  over  the  field  of  rational  functions,  generated  by  the  columns 
of  the  2p  x  p  matrix  K  =  [I,K']'.  Then  use  the  algorithm  presented  in  [9] 
to  find  a  minimal  polynomial  basis  in  7  .  Let  n.  be  the  degree  of  the 

N  1 

i:th  element  in  this  basis,  i.e.,  the  greatest  degree  of  the  2p -polynomials 
in  the  i:th  2p-tuple.  Then  the  minimality  of  the  basis  means  that  n  := 
n^  +  n7  +  ...  +  n^  is  as  small  as  possible.  Let  Q  :=  [Q* ,Q']'  be  the 
2p  x  p  polynomial  matrix  formed  by  this  basis.  Then 

K  =  QQ'1,  (7.1) 

where  Q  and  Q  are  right  coprime  polynomial  pxp  matrices  which  are  column 
proper  [10],  i.e.,  the  high  order  coefficient  matrices  [Q]^  and  [Q]^  are 


full  rank  llQl^  is  the  constant  matrix  whose  i:th  column  consists  of  the 
ni 

coefficients  of  s  in  the  i:th  colunui  of  Q.)  The  numbers  n ^ ,  n„,  n 

are  called  the  indices  of  Q  (or  of  Q)  [9;  Main  Theorem  and  Theorem  5]. 


LEMMA  7.1.  Suppose  that  k  is  given  by  (7.1).  Let  f  £  (H,,k)  end 
define  g  *  fQ.  Then  £  t  R  [  s  ] ,  where  R  Is]  is  the  el  ess  of  p-dvnensional 
i  row)  restore  of  oclunorrlals  with  real  so effi eier.ts. 


Proof.  In  view  of  (7.1),  the  representation 

(H^k)1  =  {f  e  H*  |  fk'1  t  H;)  (7.2) 

[7,  p.  75]  can  be  written  in  the  form 

(<k)X  =  {gQ'1  e  H*2  |  gQ_1  £  fQ.  (7.3) 

Set  h  : =  gQ  * .  Let  f  £  (H*k)X.  Then,  since  f  £  g  =  fQ  is  analytic 

in  the  open  right  half  plane.  Similarly,  since  h  c  g  =  hQ  is  analytic 

in  the  open  left  half  plane.  Also  f  £  (H^k)-1  implies  that  f  can  be 
analytically  extended  to  the  imaginary  axis  [4;  p.  270,  Lemma  13. o],  so  there¬ 
fore  g  -  fQ  is  analytic  there  too.  Hence  g  is  an  entire  function.  Ke 

p 

want  to  prove  that  g  £  R  (s ] .  To  this  end,  first  note  that  k  :=  detk  is  a 

Blasche  product,  i.e.,  k  is  the  product  of  relatively  prime  functions  k^(s)  : 
ni  n: 

(s  -  sp  /(s  ♦  S^)  (where,  for  each  function  k^ ,  s^  is  a  complex  number 
and  m  an  integer),  and  that  k  is  an  inner  divisor  of  kl  [7;  p.  70]. 

Then  H*k  c  H*k  [7;  p.  69]  and  H* k  =  ru(H,,h^)  so  that 

(H^K)1  c  (H^)1  -Vi(^k.)i.  (7.4) 

Therefore,  if  we  could  prove  that,  for  each  i,  (H,k.)X  is  a  space  of  rational 
vector  functions,  the  same  holds  true  for  (b.k)1,  and  consequently  the  en¬ 
tire  function  g  must  be  a  vector  polynomial .  Since  k^  is  a  scalar  inner 
function,  it  suffices  to  prove  that  an  arbitrary  component  of  any  vector 


l 


function  in  is  rational;  hence,  for  the  rest  of  the  proof,  it  is  no 

restriction  to  assume  that  H*  is  a  Hardy  space  of  scalar  functions.  Now, 
using  Cauchy's  formula,  it  can  be  shown  [8;  p.34]  that 

1  fs  '  sil  j  . 


e  •  (s )  = 


s  ♦  s. 


s  +  s 


;j 


;  j  =0,  1,  2,  ... 


is  an  orthogonal  basis  of  H*.  However,  e^.k^  =  ej  +  n.  ’  anc*  cons equent  1  y 

H*k.  is  the  closed  linear  hull  of  {e  ,  e  Hence,  (H^k.)1  is 

2  l  n.n.+l  2  l 

l  l 

the  linear  span  of  {eQ,  e^,  . .  . ,  e^  which  is  a  space  of  rational 


functions  as  required. 


□ 


PROPOSITION  7.3.  Let  X  be  a  finite  dimensional  regular  Markovian  split¬ 
ting  subspace  and  let  (W,  W)  be  the  corresponding  pair  of  spectral  factors. 
Then  there  is  an  m  x  p  polynomial  matrix  P  such  that 

(7.5) 


W  =  PQ*1  and  W  =  PQ_1 


where  Q  and  Q  are  defined  by  the  (right  coprime  and  column  proper)  factori¬ 
zation  (7.1)  of  (5.9).  The  function  P  has  a  left  inverse. 


Proof.  Equations  (5.9)  and  (7.1)  together  yield  WQ  =  WQ.  Call  this 
matrix  function  P;  then  equations  (7.5)  hold.  Since  W  has  a  left  inverse 
so  does  P.  It  remains  to  show  that  P  is  a  matrix  of  polynomials.  Since 

Hence,  by 

Lemma  7.1,  P  is  a  polynomial  matrix.  □ 


WK  *  =  W,  (7.2)  implies  that  the  rows  of  W  belong  to  (H^K)1 


LEMMA  7.2.  For  i,j  =  1,  2,  ...,  p,  let  p_  and  q_  be  polynomials 
such  that  =  (Q"1)ij-  Then,  for  each  i,  deg  p^  -  deg  q„  £  -  ni 

with  equality  for  some  j. 

Proof.  By  Cramer's  rule,  [Q^s)]^.  =  (-1)  1+:,A^  i  (s)/A(s) ,  where  A  :=  det 
and  A^  is  the  determinant  of  the  matrix  obtained  by  deleting  row  j  and 


L 


_ 1 


_ --■> . — 


.  _ * 


column  i  in  Q.  Hence,  A.^  is  a  sum  of  products  of  one  element  from  each 
of  all  columns  of  Q  except  the  i:th,  and  consequently  deg  A  ^  s  n  -  n,. 
Since  [Q]^  is  full  rank,  for  each  i  there  is  a  j  such  that  equality 
holds.  In  fact,  in  each  column  i  of  Q  there  is  a  row  j  such  that  delet¬ 
ing  row  i  and  column  i  in  [Q]^  leaves  a  nonsingular  matrix.  Hence  in 
forming  A^  there  is  at  least  one  product  that  contains  only  factors  of 
highest  degree.  Since  deg  A  =  n,  the  lemma  follows.  □ 

THEOREM  7.1.  Let  k  be  gi ven  by  (7.1),  end  let  n^,  nv  ...,  n  ^  be 
the  indie es  of  Q.  Then 


(H*ki 1  =  r,  ,q' 

(n^ ,  n , . n^)x 


•jr.eve  " 


(7.o) 


L n  1 ,  n, ,  ....  n  ) 


is  the  set  op  all  g  e  R  [s  ]  siteh  that,  foi 


i  =  1 .  7 . p,  deg  g^  <  n.  . 


Proof.  From  (’.3)  it  follows  that  the  functions  in  (H^k)1  are  of  the 

form  gQ  *  where  g  is  a  row  vector  of  polynomials  (Lemma  ~.l).  It  just 

remains  to  show  that  the  functions  g  satisfying  gQ  *  e  H*  and  gQ"  *  t.  H~ 

are  precisely  those  in  T,  .  .  But,  since  Q  and  Q  have  the 

(n^  n, . n  )  x  s 

same  indices,  this  follows  from  Lemma  7.2.  u 


COROLLARY  7.2.  Let  X  be  a  finite  dimensional  2’egular  Markovian  split¬ 
ting  subspaees ,  let  (IV,  IV)  be  the  eo  responding  pair  of  speeiral  fee  zees , 


and  let  Q  and  Q 


rro per  rzgnt  eevrzre  re h>  natmees  saz:s- 


QQ"1  =  w'Sv, 


(7.7) 


X  -  f"r. 


j  ••••  n  ) 


(iu))P‘L(iu))dy(icj), 


(7.S) 


-CO 


where  P  is  the  polynomial  matrix  P  =  WQ,  n^,  n1,  ....  arc  th< •  indices 

of  Q,  and  T  is  defined  as  in  Theorem  7.1.  The  dimension  of  X  is  equal 

to  n  :  =  n ,  ♦  n  -♦...■*•  n  . 

1  2  p 


Proof.  Theorems  5.2  and  7.1  imply  that 


=  r  s(iu))Q  1  (iw)du(  ioj) 

j  l 11  j  »  nj»  ••••  n  J 


17.9) 


Since  W  =  PQ  1 ,  du  =  QP  and  consequently  (7.8)  follows.  By  Proposi 
tion  7.3,  P  is  a  polynomial  matrix.  The  statement  concerning  dim  X  is 
immediate.  □ 

Next  we  proceed  to  find  a  basis  in  X.  To  this  end,  first  define  the 
n  *  p  polynomial  matrix 


ri(S)  =  diagill  (s)  ,  TT  (s),  ....  7T  (s )  > 


(7.10) 


2  k-1 

where  n,  is  the  k -dimensional  column  vector  tt^s)  :=  H*  s»  s~ . s  )' 

of  powers  of  s,  and  n^,  n,,  ....  n  are  the  indices  of  Q.  Then,  since 


]Q]^  is  nonsingular,  Q  may  be  written 

Q(s)  =  [Q]h(diag(s  S  ",  ...,  s  *’)  +  Allis)),  (7.11) 

where  A  is  the  p  *  n-dimensional  constant  matrix  of  polynomial  coefficients, 
Now,  in  view  of  (7.8),  the  stochastic  vector  x  defined  by 


x  =  [  JlliuOP  L( iu))dy( iu>) 


(7.12) 


is  a  basis  in  X. 

To  obtain  a  dynamical  representation  for  x,  define  the  shift  matrix 


J  =  diag{J  ,  .1  . J  ), 

nl  n2  np 


(7.13) 


where  J.  is  the  companion  matrix  with  characteristic  polynomial  \.  (s)  =  s 

K  k 

[i.e.,  J,  is  a  k  *  k  matrix  with  (J,  ).  .  *  1  whenever  i  =  i  ♦  1  and  zero 
1  k  k  l  j 

otherwise],  and  the  p  x  n  matrix  E  with  ones  in  positions  (.'I'? _ ^ n.  ,  j  )  and 


zeros  elsewhere. 
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LEMMA  7.3  [10].  Let  the  n  x  n  matrix  A  and  the  n  x  p  matri.x  B  be 


defined  by 


A  =  J  -  EA 


i 


Then 


(7.14) 


nCs)Q(s)'1  =  (si  -  A)_1B. 


(7.15) 


Proof.  By  definition, 

(si  -  A)II(s)  =  (si  -  J)II(s)  +  EATI(s) . 

But  it  is  not  hard  to  see  that 

,  nl  n?  nn. 

(si  -  J)n(s)  =  E  diag{s  ,  s  ....  s  p} 

and  consequently  (si  -  A)II(s)  =  BQ(s)  .  □ 

The  pair  (A,B)  defined  by  (7.14)  is  the  Luenburger  controllable  canon¬ 
ical  form,  and  n^,  n^,  ...,  n^  are  the  controllability  indices  [9,10]. 

THEOREM  7.2.  Let  rank  $  =  p.  Then  to  each  regular  Markovian  split¬ 
ting  subspace  X  of  dimension  n  <  °°  there  corresponds  a  stochastic  reali¬ 
zation 

dx  =  Axdt  +  Bdu  (7.16a) 

y  =  Cx,  (7.16b) 

* 

where  A,  B  and  C  are  constant  matrices  of  dimensions  n  *  p,  n  *  p  and 
m  x  n  respectively ,  such  that ,  for  all  t  £  R,  x(t)  is  a  basis  in  l^X, 
(u(t)  ;  t  e  R}  is  a  Wiener  process  satisfying  H~(du)  =  S  =  H"  v  X,  A  is  a 
stability  matrix ,  (C,A)  is  observable ,  and  (A,B)  is  in  controllable  canon¬ 

ical  form  with  controllability  indices  n^,  n£,  ...,  n^.  The  triplet  (A,B,C) 
is  determined  in  the  following  way:  Let  (7.1)  be  a  column  proper  and  right 


k  - - ; _ : _ — 


coprime  factorization  of  the  inner  function  K  corresponding  to  \,  ana  let 
rij,  n , ,  n  i  be  the  indices  of  Q.  Then  A  arui  B  <  ire  defined  bp  (?.!•*< 

and  C  as  the  coefficient  matrix  of  I\,  i.e., 


cn(s)  =  pis) . 


17.17) 


Proof.  Define  the  n-dimens ional  process  { x (. t )  ;  t  c  R}  with  components 
x.(t)  :*  U^x^ ,  k  *  1,  2,  ....  n,  x  being  the  stochastic  vector  (7.12). 

Then  x(t)  is  a  basis  in  X  : =  U^X  for  all  t  t  R,  and,  since  I'  '  dy  =  Q  'du. 


x(t)  = 


L 


e*l0tn(  iu')Q  '  (iu>)du(iu>) , 


(7.181 


where  the  Wiener  process  {u(tl  ;  t  c  R }  is  determined  by  (5.5)  and  Theorem  3.1 

Now,  inserting  (7.151  into  this  and  transforming  to  the  time  domain,  wo  obtain 

t 


x(tl  = 


A(t-rl„  .  ,  , 
e  Bdu(t) , 


(7.191 


which  is  the  integrated  version  of  (7.1ba).  In  fact,  since  dot  Q  is  the 
character ist ic  polynomial  of  A  [9],  all  eigenvalues  of  A  lie  in  the  open 
left  half  plane,  and,  since  Q  is  a  minimal  basis  in  V’  (i.e.,  n  is  as 
small  as  possible) ,  the  pair  (C,A)  is  observable.  To  establish  (7.1  t»b 1 . 
first  note  that,  in  view  of  (3.3),  y(o)  e  X;  hence,  there  is  a  matrix  C 
such  that  y (o)  =  Cx.  Applying  the  operator  li  to  this,  (7.1bb)  follows. 
It  is  clear  from  (7.12)  that  C  is  given  by  (7.17).  0 


Note  that  we  can  obtain  a  whole  class  of  equivalent  realizations  (7.1o) 
through  transformations  of  the  type 

(A.B.Clh-*  (T_1AT,  T'V  CT), 

where  T  is  any  nonsingular  constant  matrix. 


.  J  4 


Tlie  complete  analysis  of  this  section  can  be  repeated  with  time  reversed. 
Indeed,  by  replacing  Q  and  i)  in  the  derivation  above,  we  obtain  a  realiza¬ 
tion  (7.1bl  in  which  the  matrix  A  has  all  its  eigenvalues  in  the  open  right 


half  plane.  To  justify  the  exchange  of  Q  and  Q,  observe  that  (5.11)  may 
also  be  written 


X  = 


(M) 


1  .A 

du, 


where  now  1  denotes  the  orthogonal  complement  in  H,.  Then  the  situation 
is  completely  symmetric. 
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